System, method, and non-transitory computer-readable storage media related to correction of vision defects using a visual display

ABSTRACT

A method of at-home monitoring of eye conditions using a head mounted display that is capable of establishing a visual model associated with a patient. The visual model may include data related to a quality of the patient&#39;s vision. The patient may use the system to establish a visual model periodically, such as daily, and the system may compare the visual model to previous visual models and send an alert to the patient&#39;s physician if changes meeting a given criteria are detected. This may allow the physician to immediately take steps to save the patient&#39;s eyesight where a delay in treatment may result in vision loss.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 16/173,719 filed Oct. 29, 2018, which claims priority to andthe benefit of U.S. Patent Application Ser. No. 62/134,422, filed onMar. 17, 2015, U.S. patent application Ser. No. 15/073,144 filed Mar.17, 2016, and U.S. patent application Ser. No. 15/940,561 filed Mar. 29,2018, the disclosures of which are hereby incorporated by reference.

FIELD OF THE DISCLOSURE

The present invention relates generally to the correction of visiondefects, and more specifically, to a system, and methods forcompensating for visual defects for detecting the vision defects,capturing an image, correcting the image and displaying a correctedimage.

BACKGROUND

Macular degeneration and other FOV (Field of Vision) related blindnessor vision defect conditions, such as end-stage glaucoma, Stargardt'sdisease, central serous retinopathy, myopic macular degeneration,diabetic macular edema, cystoid macular edema, macular holes, macularatrophy, anterior ischemic optic neuropathy and retinitas pigmentosa areoften irreversible. The impact to a patient's life due to the loss of aportion of their vision is enormous, including degraded and loss of theability to read, watch TV and see computer screens. Some of theconditions can be halted, and fortunately leaves some of the visionintact, and in the case of Macular Degeneration, the peripheral visionremains intact.

There have been previous attempts to augment the sight of a patientwhose other sight is defective or otherwise impaired, or otherwisecompensate for the patient's damaged or impaired sight. For instance,previous efforts have focused on the devices that increase the intensityor contrast of the patient's sight and/or increase the magnification ofthe image seen by the patient. These attempts have not been veryeffective and are bulky and expensive.

The present invention is aimed at one or more of the problems identifiedabove.

SUMMARY OF THE INVENTION

In one embodiment, a system having a database, a model controller, adisplay controller and a display unit is provided. The model controlleris coupled to the database and is configured to establish a visual modelassociated with a patient and to store the visual model in the database.The visual model includes data related to a quality of the patient'svision. The model controller is further configured to establish aboundary as a function of data associated with the visual model. Theboundary is indicative of an area to be corrected within the patient'svision. The model controller is further configured to establish aretinal map as a function of the boundary and to store the retinal mapin the database. The display controller is configured to receive and tostore the retinal map. The display controller is further configured toreceive an image from a camera or cameras from associated with thepatient and to apply corrections to the image based on the retinal mapand responsively generate a corrected image. The display unit is coupledto the display controller and is configured to receive the correctedimage to present the corrected image to the eye of the patient.

In other embodiments, a method is provided. The method includes thesteps of establishing, by a model controller, a visual model associatedwith a patient and storing the visual model in the database. The visualmodel includes data related to a quality of the patient's vision. Themethod further includes the step of establishing, by the modelcontroller, a boundary as a function of data associated with the visualmodel, the boundary being indicative of an area to be corrected withinthe patient's vision. The method also includes the steps ofestablishing, by the model controller, a retinal map as a function ofthe boundary and storing the retinal map in the database, receiving, ata display controller, an image from a camera or cameras associated withthe patient, applying corrections to the image based on the retinal map,and responsively generating a corrected image. Further, the methodincludes the steps of receiving, at a display unit, the corrected imageand presenting the corrected image to the eye of the patient.

In still other embodiments, one or more non-transitory computer-readablestorage media, have computer-executable instructions embodied thereon.When executed by at least one processor, the computer-executableinstructions cause the at least one processor to establish, by a modelcontroller, a visual model associated with a patient and storing thevisual model in the database. The visual model includes data related toa quality of the patient's vision. A boundary is established as afunction of data associated with the visual model, the boundary beingindicative of an area to be corrected within the patient's vision. Aretinal map is established as a function of the boundary. An image froma camera or cameras associated with the patient is received at a displaycontroller. Corrections are applied to the image based on the retinalmap, and a corrected image is generated. The corrected image ispresented to the eye of the patient.

BRIEF DESCRIPTION OF THE FIGURES

Other advantages of the present disclosure will be readily appreciated,as the same becomes better understood by reference to the followingdetailed description when considered in connection with the accompanyingdrawings wherein:

Non-limiting and non-exhaustive embodiments of the present invention aredescribed with reference to the following figures, wherein likereference numerals refer to like parts throughout the various views,unless otherwise specified;

FIG. 1 is a block diagram of a system to augment a patient's vision,according to an embodiment of the present invention;

FIG. 2 is a diagrammatic illustration of a patient's vision without adefect;

FIG. 3 is a diagrammatic illustration of a patient's vision with adefect;

FIG. 4A is an illustration of a sample visual model, according to anembodiment of the present invention;

FIG. 4B is an alternative view of the sample visual model of FIG. 4B;

FIG. 4C is an illustration of first and second boundaries, according toan embodiment of the present invention;

FIG. 4D is an illustration of first and second boundaries, according toanother embodiment of the present invention;

FIG. 5 is an illustration of a complex boundary, according to anembodiment of the present invention;

FIG. 6 is an illustration of a simple boundary comprised from one of aplurality of predefined shapes;

FIG. 7 is an illustration of a patient's vision with a more complexdefect;

FIG. 8 is an illustration of a boundary associated with the illustrationof FIG. 7;

FIG. 9 is a diagrammatic illustration used in establishing a retinalmap, according to an embodiment of the present invention;

FIG. 10 is a diagrammatic illustration used in establishing a retinalmap, according to an embodiment of the present invention;

FIG. 11 is a diagrammatic illustration used in establishing a retinalmap, according to another embodiment of the present invention;

FIG. 12 is a diagrammatic illustration of a head mounted display unit,according to an embodiment of the present invention;

FIG. 13 is a second diagrammatic illustration of the head mounteddisplay unit of FIG. 12;

FIG. 14 is a diagrammatic illustration of a heads up display unit,according to an embodiment of the present invention;

FIG. 15 is a flow diagram of a method for augmenting the vision of apatient, according to an embodiment of the present invention;

FIG. 16 is a graphical illustration of a first example of a manipulationof prescribed retinal interface, according to an embodiment of thepresent invention;

FIG. 17 is a graphical illustration of a second example of amanipulation of prescribed retinal interface, according to an embodimentof the present invention;

FIG. 18 is a flow diagram of a process for establishing a digital fieldof vision map, according to an embodiment of the present invention;

FIG. 19 is a graphical illustration of a first portion of the process ofFIG. 18;

FIG. 20 is a graphical illustration of a second portion of the processof FIG. 18;

FIG. 21 is a graphical illustration of a third portion of the process ofFIG. 18; and

FIG. 22 is a graphic illustration of an Amsler map of a patient withnormal vision and an Amsler map of a patient with AMD.

Corresponding reference characters indicate corresponding componentsthroughout the several views of the drawings. Skilled artisans willappreciate that elements in the figures are illustrated for simplicityand clarity and have not necessarily been drawn to scale. For example,the dimensions of some of the elements in the figures may be exaggeratedrelative to other elements to help to improve understanding of variousembodiments of the present invention. Also, common but well-understoodelements that are useful or necessary in a commercially feasibleembodiment are often not depicted in order to facilitate a lessobstructed view of these various embodiments of the present invention.

DETAILED DESCRIPTION

In the following description, numerous specific details are set forth inorder to provide a thorough understanding of the present invention. Itwill be apparent, however, to one having ordinary skill in the art thatthe specific detail need not be employed to practice the presentinvention. In other instances, well-known materials or methods have notbeen described in detail in order to avoid obscuring the presentinvention.

Reference throughout this specification to “one embodiment”, “anembodiment”, “one example”, or “an example” means that a particularfeature, structure or characteristic described in connection with theembodiment or example is included in at least one embodiment of thepresent invention. Thus, appearances of the phrases “in one embodiment”,“in an embodiment”, “one example”, or “an example” in various placesthroughout this specification are not necessarily all referring to thesame embodiment or example. Furthermore, the particular features,structures or characteristics may be combined in any suitablecombinations and/or sub-combinations in one or more embodiments orexamples. In addition, it is appreciated that the figures providedherewith are for explanation purposes to persons ordinarily skilled inthe art, and that the drawings are not necessarily drawn to scale.

Embodiments in accordance with the present invention may be embodied asan apparatus, method, or computer program product. Accordingly, thepresent invention may take the form of an entirely hardware embodiment,an entirely software embodiment (including firmware, resident software,micro-code, etc.), or an embodiment combining software and hardwareaspects that may all generally be referred to herein as a “unit”,“module” or “system.” Furthermore, the present invention may take theform of a computer program product embodied in any tangible media ofexpression having computer-usable program code embodied in the media.

Any combination of one or more computer-usable or computer-readablemedia (or medium) may be utilized. For example, a computer-readablemedia may include one or more of a portable computer diskette, a harddisk, a random access memory (RAM) device, a read-only memory (ROM)device, an erasable programmable read-only memory (EPROM or Flashmemory) device, a portable compact disc read-only memory (CDROM), anoptical storage device, and a magnetic storage device. Computer programcode for carrying out operations of the present invention may be writtenin any combination of one or more programming languages.

The flowchart and block diagrams in the flow diagrams illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It will also be notedthat each block of the block diagrams and/or flowchart illustrations,and combinations of blocks in the block diagrams and/or flowchartillustrations, may be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions. These computerprogram instructions may also be stored in a computer-readable mediathat can direct a computer or other programmable data processingapparatus to function in a particular manner, such that the instructionsstored in the computer-readable media produce an article of manufacture,including instruction means which implement the function/act specifiedin the flowchart and/or block diagram block or blocks.

Several (or different) elements discussed below, and/or claimed, aredescribed as being “coupled”, “in communication with”, or “configured tobe in communication with”. This terminology is intended to benon-limiting, and where appropriate, be interpreted to include withoutlimitation, wired and wireless communication using any one or aplurality of a suitable protocols, as well as communication methods thatare constantly maintained, are made on a periodic basis, and/or made orinitiated on an as needed basis.

The disclosure particularly describes a system 10, method M10 andcomputer program instructions stored in media, that augment the sight ofan individual or patient whose sight has been damaged or is otherwisedefective. In general, the present invention provides techniques thatmay be implemented in systems, methods, and/or computer-executableinstructions that (1) map the defective areas of the patient's sight,(2) establish one or more boundaries that delineate between theeffective and defective areas of the patient's eye(s), (3) capture animage (or series of images) using a camera associated with the patient,(4) map the capture image (or series of images) and generate a correctedimage (or series of images), and (5) present the correct image(s) to thepatient's eye(s).

With reference to FIG. 1, an exemplary system 10, according to oneembodiment of the present invention, is illustrated. The system 10includes a database 12, a model controller 14, a display controller 16,and a display unit 18. As will be discussed in more detail below, a datagathering unit 20 is used to gather data that may be used to develop avisual model of the patient's eyesight. The data used to establish thevisual model, the visual model and other data is stored in the database12. Since the peripheral receptors, in the macular degeneration case, inthe retina are usually still functioning, the present inventionstretches, skews and/or otherwise manipulates the image(s) presented tothe eye(s) of the patient to avoid the macula or the damaged portions ofthe macula. Thus, the entire image is presented to, or onto, thefunctioning retinal receptors. As explained in more detail below, thepresent invention creates a distortion map of the image and displays it,or projects it onto the periphery of the eye(s), while avoiding the(damaged portion of the) macula. The distorted image is presented to,projected onto, the eye using (high definition) goggles, glasses, a“smart” contact lens, or a photon projection (using a virtual retinadisplay) of the image directly onto the periphery of the eye.

In general, the model controller 14 is coupled to the database 12 and isconfigured to establish the visual model associated with a patient andto store the visual model in the database. The visual model includesdata related to a quality of the patient's vision. The model controller14 is further configured to establish a boundary as a function of dataassociated with the visual model. This process is discussed in furtherdetail below. The boundary is indicative of an area to be correctedwithin the patient's vision. The model controller is further configuredto establish a retinal map as a function of the boundary and to storethe retinal map in the database.

The display controller 16 is configured to receive and to store theretinal map. The display controller 16 is further configured to receivean image (or series of images) from a camera, such as a video camera,(see below) associated with the patient and to apply corrections to theimage(s) based on the retinal map and responsively generate correctedimage(s).

In one aspect of the present invention, one or more retinal maps may begenerated. The retinal map may be associated with predefined settings,for examples, day time, night time, reading, etc. The correct retinalmap may be automatically selected for specific conditions and/or may beuser selectable to fit changing conditions.

The display unit 18 is coupled to the display controller 16 and isconfigured to receive the corrected image(s) and to present thecorrected image(s) to the eye of the patient. It should be noted thatthe present invention may be configured to present corrected video, as aseries of images, to the eye of the patient.

In general, the model controller 14 and database 12 may be anembodiment, in a computer, specific or specifically designed hardware orapparatus, server, or servers operating independently, or in a networkedenvironment. The data gathering unit 20 (described in further detailbelow) may be linked, at least temporarily, or may be data transferredover a network, electronically, or through a physical media.

In one aspect of the present invention, the retinal map may beestablished automatically and adjusted (with or without the patient'sinput) at or by the model controller and then transferred electronicallyto the display controller.

In another aspect of the present invention, the model controller 14 mayestablish a plurality of retinal maps that vary in either the parametersused to generate the retinal map and/or the method used to generate theretinal map. The plurality of retinal maps may be stored at the displaycontroller 16. The patient may then cycle through the retinal maps andselect, for use, one of the retinal maps that works best. For instance,a particular retinal map may work best for the instant conditions. Thus,the patient may select a retinal that works best for the conditionswhich currently exist.

As discussed more fully below, the display controller 16 and the displayunit 18 may be embodied in a head mounted display, goggles, or glassesthat are mounted to, or worn by the patient. Alternatively, the displaycontroller 16 and display unit 18 may be embodied in a unit that isseparated from, i.e., not worn by, the patient. One or more sensors (notshown) may be utilized to find the location and distance of the patientrelative to the display unit 18 such that the image may be displayedproperly.

Each eye of the patient is different. For instance, one eye of thepatient may have a specific defect (having a specific shape, size andlocation), while the other eye of the patient may not have a defect ormay have a defect having a different shape and size. Thus, each eye ofthe patient will generally be mapped and a respective visual model ofeach eye established. A boundary of the defect of each eye will begenerated and an associated retinal map generated. In one embodiment,separate cameras will generate a separate set of images for each eye andthe display controller 16 will generate a respective series of images tobe presented to each eye.

With reference to FIG. 2, a graphic 22A representing the vision of apatient's eye without a defect is shown for purposes of comparison. Withreference to FIG. 3, a graphic 22B representing the vision of apatient's eye with a defect is shown. The defect is represented by thedark shape 24 shown in the center of the graphic 22B.

In one aspect of the present invention, the visual model may beestablished using the data gathering unit 20. The data gathering unit 20may include at least one of (1) a field of vision ophthalmologicalinstrument, (2) a portable mobile field of vision test apparatus, and(3) a computer based system. The process of gathering data using thedata gathering unit 20 is discussed in more detail below.

With reference to FIG. 4A, a simplified example of field of vision (FOV)data 26 is shown. The FOV data 26 is used to create the visual model.The FOV data 26 includes a plurality of cells 28 arranged in a grid 30.Each cell 28 has an associated value associated with the quality of thepatient's vision. The values may be based on an absolute orrepresentative scale that is indicative of the quality of vision.Alternatively, the values may be a deviation from a standard value, or avalue of an associated cell. For purposes of explanation, in theexemplary FOV data 26 of FIG. 4A, the values in the grid utilize a scaleof 0-9, where 0 represents no defect, 9 represents a defect and thevalues 1-8 represent a quality of vision between 0 and 9. It should benoted that a scale of 0-9 is for discussion purposes only. The scaleutilized may be any suitable scale, for example, 0-99, 0-255, −30 to 30,or any suitable scale. Furthermore, the illustrated grid having 12 rowsand 20 columns. The shape of the grid may be used to approximate theshape of an eye and may be different between the left and the right eye.However, the size and the shape of the grid may be based on a 12×20grid, however, any size grid may be utilized. The size of the grid maybe dependent upon the data gathering process, or data gathering unit 20and/or the display unit 18. In another embodiment, the FOV data may berepresented by a contour, polygon or morphological operator.

The boundary may be established as a function of the values associatedwith the cells in the grid. In one embodiment, the values in the gridvalues are compared with a threshold to establish the boundary. Forexample, in the above example, the threshold may be set to 7. Thus, anycell 28 having a value of 7 or greater is within the boundary and anycell 28 having a value of 0 is outside of the boundary. A modified viewof the FOV data 26 is shown in FIG. 4B, in which the cells 28 meetingthe above threshold are highlighted.

Alternatively, the FOV data 26 could be used to create a contour. Thevisual model emerges from interpreting the raw data and is notnecessarily a point-by-point transformation of the raw data.

With reference to FIG. 5, an exemplary boundary 32 is shown. The area32A is within the boundary 32 and the area 32B is outside of theboundary.

In one aspect of the present invention, the data comprising the visualmodel may be filtered or transformed to eliminate noise or otherundesirable effects within the data prior to the boundary (orboundaries) being established. This process may be performedautomatically using a set of predefined operations or may be performedunder the control of an operator of the model controller 14. Forinstance, the data may be filtered using one or more morphologicaltransformations. Possible morphological transformations or operationsmay include, but are not limited to: erosion, dilation, opening,morphological gradient, top hat, and/or black hat. An initial boundarymay be established using pre-filtered data and a secondary boundary maybe established after the data has been filtered or transformed. Theinitial and secondary boundary may be compared automatically or by theoperator to optimize the boundary used. Alternatively, Booleanoperations may be used to filter the visual model and/or combiningboundaries.

In one aspect of the present invention, the threshold is adjustable,either at the model controller 14 or at the display controller 16. Ifperformed at the model controller 14, this would provide control to theoperator. In adjusting the threshold, the operator could optimize theboundary. If performed at the display controller 16, control would beprovided to the patient. This would allow the patient to adjust theboundary to optimize the boundary for current conditions.

In another aspect of the present invention, the model controller 14, inestablishing the boundary, is configured to establish a first boundaryand a second boundary. The model controller 14 is configured to evaluatethe first and second boundaries and to responsively establish a finalboundary. The first and second boundaries may be joined into a singleboundary (incorporating at least a portion of each of the first andsecond boundary). Alternatively, one or both of the boundaries may beeliminated if the boundary does not meet a set of predefined criteria.For instance, if one of the boundaries does not have a predeterminedheight, width, or total area, then it may be eliminated.

In another embodiment of the present invention, the boundary 32 may beadjusted or replaced with a simpler form (boundary 32′, see FIG. 6). Forinstance, the boundary 32 may be replaced with a boundary established asa function of one or more predesigned shapes and the visual model. Themodel controller 14 may utilize a set of predefined set of shapes, forexample, rectangles, triangles, ovals that are sized to include theaffected area. The model controller 14 may select one or more shapesautomatically, or the process may be performed by, or with theassistance of, the operator.

With reference to FIG. 7, the shape of the defect or damaged area 24′may be more complex. A complex boundary may be established using thethreshold process identified above, or by some other method.Alternatively, the initial boundary may be replaced automatically, orwith operator input using one or more of the predefined shapes, sized tocover the defect. In the example of FIG. 8, two shapes 34A, 34B areused. The boundary may be formed by the outer edge of the joined shapes.

With reference to FIGS. 9 and 10, in one aspect of the presentinvention, the image data inside the boundary 32 is shifted outside ofthe boundary 32. In the example shown in FIG. 9, first a center point 36is established. The center point 36 may be an actual center of theboundary if the shape of the boundary is regular, or it may be definedby finding or estimating the center of the shape defined by theboundary. In one embodiment, image data along a plurality of rays 37starting at the center point and extending outward is shifted outside ofthe boundary. It should be noted that in the above examples, the areasinside the boundary or boundaries are defective. However, in somesituations, for example, where peripheral vision is affected, the areainside a boundary may be associated with good vision and the areasoutside of a boundary may be associated with poor vision.

In one embodiment, the retinal map includes a series of data pointswhich overlay the digital model. The data points are laid out in a gridin a regular pattern. Each data point is defined by a set of X, Ycoordinates relative to the image data. As explained in detail below,each data point is assigned a set of coordinate transformation values(ΔX, ΔY), which is used to transform the image data. Each data pointlies on a single ray which extends outward from the center point 36. Foreach data point, the associated ray is found and a set of coordinatetransformation values (ΔX, ΔY) are established based on a set ofpredetermined rules. The coordinate transformation values (ΔX, ΔY) areused as coefficient values in the transformation equations below.

In one embodiment, visual information in the image from the camera isradially shifted from a central point. For instance, in one embodimentthe image data from the center point 36 to the edge of the image 38 iscompressed (in the corrected image) from the boundary 32 to the edge ofthe image 38. Thus, the coordinate transformation values (ΔX, ΔY) forany data point lying on the ray may be calculated based on the length ofthe distance from the center point 36 to the boundary 32, and the lengthfrom the center point 36 to the respective edge of the image 38.

In an alternative embodiment, the coordinate transformation value (ΔX,ΔY) is calculated such that the visual information is disproportionallyshifted from the center point. For example, with respect to FIG. 11,visual information from the center point 36 to the boundary 32 may beshifted to a segment of the ray defined by the boundary 32 and a point32′. The length between the boundary 32 and point 32′ may be equal to ordifferent than the length between the center point and the boundary 32.In this embodiment, the visual information between the boundary and theedge of the image 38 may be compressed between point 32′ and the edge ofthe image 38. Not only can the visual information be shifted out towardsthe periphery but can also be accomplished in reverse and the visualinformation can be shifted inward as well.

Once coordinate transformation values are established, the retinal mapis stored in the database 12 and transferred to the display controller16. In use, the retinal map is then used to transform the image(s)received from the camera and generate the corrected image(s). Thecorrected image(s) may then be displayed in real-time via the displayunit 18.

In one aspect of the present invention, the visual information istransformed (or moved) at each data point. The visual informationbetween the data points may be transformed using a spline function,e.g., a B spline function, to interpolate the visual information betweenthe data points. In another aspect of the invention, the pixels relatingto the data portion of the image which is moved are reduced to smallerpixels, such that the moved pixels and the preexisting pixels occupy thesame space on the display. Or, the removed and replaced pixels may beinterlaced into a video frame consisting of two sub-fields taken insequence, each sequentially scanned at odd then even lines of the imagesensor.

The display controller, in generating the corrected image, shifts visualinformation within the corrected image in a first area inside theboundary to a second area outside of the boundary as a function of theseries of data points. The coordinate transformation values are used toshift image data that exists inside the boundary to an area outside ofthe boundary. In the above example, the second area is defined as anyarea in the image that is outside of the boundary.

In another embodiment, the second area may be defined based on the datain the visual model. For example, a second boundary may be establishedas a function of the data in the visual model. In one example, thesecond boundary may be established based on the visual model that meetspredefined criteria. For example, an area within the visual model may beestablished cells 28 in the grid 30 that have a value that meetspredefined criteria. In the example above, for instance, the secondboundary may encompass an area of the grid 30 in which the cells 28 havea value of 3 (or some other threshold) or less. In this embodiment, theinformation inside the first boundary 32 is shifted (proportionally ordisproportionally) into the area defined by the second boundary.Examples of an area defined by a first area 32A and an area defined by asecond area 32C are shown in FIGS. 4C and 4D. In both examples, visualinformation in one of the areas 32A or 32C may be shifted towards orinto the other one of the areas 32A, 32C. In the illustrated examples,the second boundary in FIG. 4C has been replaced with a simplershape/form in FIG. 4D.

In one aspect of the present invention, the display controller 16 andthe display unit 18 may be implemented in a suitable user wearabledevice, such as smart glasses or head mounted displays (HMDs). Suchdevices are available and/or in development from Lumus, OstherhutDesign, Meta, Magic Leap, Microsoft, Oculus, Google, Sony, Epson, Immyand other vendors. In all cases, these hardware wearable platforms allcontain wearable glasses that contain one or two forward mountedcameras, and onboard microprocessor, display technologies for viewing bythe eye. Furthermore, these are usually battery powered, as well as ableto plug into a PC in order to upload information via a USB cable etc.and/or for charging. This may also include HUD (Heads Up Displays), forexample, the offering from Meta can be worn over a patient's existingglasses with prescription lenses 62 in order to facilitate movingbetween the two modes of normal vision and the augmented IDM (ImageDistortion Map) vision. These wearable HMDs can include differentdisplay technology such as separate LCD, LED, OLED type of displays. Ingeneral, these devices may include an embedded display on the actuallenses of the glasses that overlay the image to view the augmenteddisplay in conjunction with the outside world. Alternatively, a virtualretina display may be used to project photons directly onto the retina,or a “smart” contact lens can project the image that is worn on the eye.Any suitable method or device to present the correction image or imagesto or onto the eye(s) may be used. Alternatively, the image or imagespresented to the patient may be otherwise opaque such that the outsideworld is not visible.

With reference to FIGS. 12 and 13, in one embodiment, the displaycontroller 16 and the display unit 18 are embodied in an exemplary headmountable display (HMD) device 50 that is worn by the patient. In theillustrated embodiment, the HMD device 50 includes a set of wearableglasses 52 that contains one or two forward mounted cameras 54. Thedisplay controller 16 may be mounted to an HMD frame 58 and include anonboard microprocessor. The display unit 18 includes a suitable displaytechnology for viewing by the eye. One or more input or control buttonsmay be provided that work in conjunction with suitable menus, andsoftware controls display on the display unit 18 to allow thepatient/user to change options. The HMD device 50 may be battery poweredand may include a USB cable or suitable port 62 to connect to, e.g., acomputer to transfer data and software and/or for charging the battery.

With reference to FIG. 14, the display controller 16 and the displayunit 18 may also be embodied in a Heads Up Displays (HUD) display device60, for example, the offering from Meta, that can be worn over apatient's existing glasses with prescription lenses in order tofacilitate moving between the two modes of normal vision and augmentedIMD vision. The HUD display device 60 are head mountable and may includedifferent display technology such as separate LCD or LED type ofdisplay. The HUD display device 60 may embed a display on the actuallenses of the glasses themselves that overlay the image to view theaugmented display in conjunction with the outside world.

With reference to FIG. 15, in another aspect of the present invention, amethod M10 according to one embodiment of the present invention isprovided. In a first step S10, a visual model associated with a patientis established, by the model controller 14 and stored in the database12. The visual model includes data related to a quality of the patient'svision. In a second step S20, at least one boundary is established, bythe model controller 14, as a function of data associated with thevisual model. At least one boundary is indicative of an area to becorrected within the patient's vision. In a third step S30, the modelcontroller 14 establishes a retinal map as a function of the boundaryand stores the retinal map in the database 12. The database may beincorporated into a semiconductor chip, which may also be existing spacein a camera chip.

In a fourth step S40, an image from a camera associated with the patientis received by a display controller 16. Corrections to the image basedon the retinal map are applied to the image and a corrected image isgenerated in a fifth step S50. In a sixth step S60, the corrected imageis received at the display unit 18 and presented to the eye of thepatient.

The system 10 and method M10, in general, remap portions of the image(s)captured by the camera(s) which would be viewed by the effected portionsof the patient's eye(s) to the periphery or unaffected portions of thepatient's vision, or alternatively to another portion of the patient'sretina. With this mapping correctly, executed the patient's brain adaptsquickly and effective central (or periphery) vision is mimicked. This isaccomplished with the forward-looking cameras as the sensor thatcaptures the real world image. The system 10 and method M10 of thepresent invention shift the pixels to form a corrected image or seriesof images which are displayed on the micro-displays on a head mounteddevice, such as readily available augmented reality and virtual realityglasses. This process is all non-invasive and depends only on theprocessor in the glasses, the remapping software, and the patient'sbrain processing power through direct observation of the micro-display.The display device utilized may be implemented in head mounted devices,suitable examples of which are these offered by companies such as Sony,Epson, Facebook, Google, etc., utilize a variety of displaytechnologies, such as LED, LCD, OLED, Photon Retinal Display, VirtualRetinal Displays, and Heads Up Displays.

Field of Vision Mapping

In order to correctly enable the pixel remapping technology of thepresent invention for enhancement of central vision (for the maculardegeneration case) and other blindness conditions, the initial mappingof the UFOV (Usable Field of Vision) must be digitally generated. Itshould be noted that the present invention is not limited to mappingfrom a center area to a peripheral area. In some cases, peripheralvision is affected and the mapping may be from the peripheral area tothe center. There are a multitude of methods to accomplish this task. Inall cases the initial examination, mapping and calibration must beconverted to a digital file. This digital file is then used to constructthe boundaries of the UFOV. The UFOV is treated as a sharp outline whereperipheral or useable vision is clear, and not degraded. However, thisboundary may be a result of evaluation and determination of thegradation of the partial vision, then interpreted to construct the UFOVboundary. This UFOV boundary is then utilized as the baseline for theIMA (Image Mapping Algorithm) to determine the area where the effectivecentral vision can be mapped into, along with the existing effectiveperipheral vision. There are numerous ways to construct the initial UFOVboundary conditions, both through direct digital means and by manualapproaches that can be then converted to a digital file. In some ofthese cases, the FOV test may be administered by a trained medicalprofessional such as an optometrist or ophthalmologist in the doctor'soffice. In other cases, an automated FOV test may be self-administeredwith the proper digital technology. In the third case, a trainedprofessional can manually administer an FOV mapping test to generate theUFOV. Any, and all, of these cases can be utilized to generate the UFOVas outlined.

In another embodiment, the output of a wearable FOV test is used. Forexample, the embodiment may use an automated program embedded in thewearable HMD/HUD display device 50, 60. An initial start-up and mappingroutine would be performed by observation, such as looking at an Amslergrid or moving objects to check the UFOV, or both, utilizing an existingFOV map to modify and optimize. Eye tracking technology may be used toensure more accurate FOV mapping and validating fixation. This result isimmediately usable directly as the digital input for the UFOV for theMatrix Mapping Technology. A sample Amsler grid of a person with normalvision and a sample Amsler grid of a person with AMD are shown in FIG.22.

With respect to FIG. 18, the general process is embodied in a methodM20. The general process is as follows:

-   -   1. The wearable HMD (Head Mounted Display) is placed on the        patient's head and would be put into “calibration” mode for FOV        mapping. (Step S70)    -   2. The wearable HMD is connected (via external cable or wireless        communication mode) to a patient feedback device, such as a PC        with a mouse, tablet, mobile phone. (Step S80) or voice        recognition technology where the patient gives verbal feedback        to the system, which recognized commands, clues and        instructions, and accomplishes the FOV mapping automatically.    -   3. The auto mapping routine is initialized. (Step S90)    -   4. Eye tracking and fixation are monitored throughout the FOV        mapping process in order to determine valid results. Given that        Macular Degeneration attacks the central vision, it is important        that the fixation and focal point test is administered through        markers or objects in the peripheral vision, as well. The valid        results can be driven with a secondary feedback loop by        constantly monitoring fixation and using only valid visual data        points for the mapping of the UFOV and retesting as necessary to        develop the entire UFOV map. (Step S170)    -   5. The FOV mapping test is administered first for the left eye        (or right eye) through use of visually moving along an Amsler        grid to see where images are warped or straight. (Steps S100 and        S110). Alternatively, a flashing object is generated to show at        different points in the patient's vision in order to determine        visual acuity through the feedback device. This is performed at        different level intensities to verify level of degradation of        vision. See FIGS. 19 and 20. Alternatively, an object is moved        through a series of sequences and with feedback, determined when        the object becomes clear from blurry to unviewable, effectively        creating gradations of the sight map. See FIG. 21.        Alternatively, a constantly expanding sphere is displayed until        the edges become clearly visible to the patient. The edges are        manipulated through the feedback device until the edge of the        UFOV is determined. The latter two cases offer the advantage of        a faster approach to FOV mapping for utilization with the        wearable later. With a quicker mapping procedure, the system is        less likely to cause fixation errors due to lack of        concentration from the patient. This also offers quicker        calibration for more frequent tweaks to the UFOV map to optimize        the performance. The further advantage that can be realized with        the patient's ability to manipulate the FOV edge is to better        personalize the calibration to their particular affliction (Step        S120).    -   6. The same test is then administered for the other eye (Steps        S130, S140, S150).    -   7. The results are validated or invalidated based on verifying        eye tracking and fixation, which is done concurrently while        administering the eye tests (Step 170).    -   8. The Digital FOV map is then generated (Step 160). The        auto-mapping and Digital FOV map can be created using voice        recognition technology where the patient gives verbal feedback        to the system, which recognized commands, clues and        instructions, and accomplishes the FOV mapping automatically.

INDUSTRIAL APPLICABILITY

With reference to the drawings and in operation, the present inventionprovides systems, and methods to stretch, skew and manipulate the imagebeing projected on the eye to avoid the macula, and be directed to theretina's peripheral receptors. Alternatively, the image can be skewed toother portions of the retina. In this way, the entire image is projectedon the functioning retinal receptors, and any involvement of the maculais avoided. The systems and methods, according to embodiments of thepresent invention, create a distortion map of the entire image andproject it onto the periphery of the eye, while avoiding the macula.This can be done by the use of computer aided 90-degree 3D or similarHigh Definition goggles or glasses, or by photon projection with avirtual retina display of the image directly onto the retina of the eye.

The present invention improves the current technique of implantationinto the actual eye. Implantation into the eye requires a surgicalprocedure involving removing the eye's natural lens, as with cataractsurgery, and replacing the lens with a tiny telescope, called anImplantable Miniature Telescope (WIT), which works like the telephotolens of a camera. The IMT is implanted behind the iris, the colored,muscular ring around the pupil. This process, which is expensive,costing up to $15,000 for an operation, doesn't cure AMD, it only helpsimprove the vision of patients to a certain extent. However, there arenumerous drawbacks including infection, surgery complications and lossof the person's lenses. Another of the drawbacks of the IMT is thattelescopes are hard to adjust once it has been implanted and must dependon an external battery and device which must be worn by the patient.Suffice it to say, this technology is invasive, requires that thepatient's own lenses be removed, is not reversible and requires bothsurgery and extensive rehabilitation. Furthermore, the rehabilitationprocess is extensive and involves training patients to effectively usethe device. Rehabilitation post-surgery takes about six months to ayear.

In some embodiments of the invention, the method and manner of theskewed projection relies on external lenses, like Google Glass, OculusRift, Magic Leap, or Meta. These High Definition goggles or glasses likeGoogle Glass, Oculus Rift, Magic Leap or Meta, have developedcommercially deployed displays with up to 2 million pixels, a resolutionseen only otherwise on ultra-high-definition TVs and tablet computers,which provide the resolution needed to put the entire image on theperipheral retina receptors in sufficient detail to be analyzed by theoptical nerve and brain.

Also, for the introduction of perspective, two cameras can to be used,and the modern goggles and glasses can accept more than one imageinterface and/or signal. Thus, the computed manipulated images arecaptured in real-time and displayed in real-time for the patient.

In addition, the goggles and/or glasses could be used to house atechnology like virtual retina display, retina scan display projection,and/or a retinal projector technology which all use photon on retinaprojection, which in this case would be modulated by the IDM (ImageDistortion Map) to the person's specific Retinal Map so that anintentionally distorted image would be projected onto the areas of theeye which have the best visual reception. In this fashion, you canproject the image directly into the portion of the peripheral retinawhich is still active in an MD patient via photons, utilizing atechnology such as a virtual retinal display (VRD), also known as aretinal scan display (RSD) or retinal projector (RP), is used. Whencombined with these technologies, the person's specific retinal map,modulated by the image distortion map, would be displayed by thetechnology which draws a raster display (like a television) directlyonto the retina of the eye, and in this case on to the usable portionsof the retina of the eye. With the VRD, RSD or RP, the patient user seeswhat appears to be a conventional display floating in space in front ofthem, which is corrected for the loss of macula, but still provides thepatient with the ability to see other peripheral obstacles, such assteps in front of the patient which the camera is not yet focused on.

Another advantage is that these types of wide field-of-vision goggles orglasses can be used in conjunction with one or more cameras, which aretypically head mounted. Another advantage of these types of glasses isthat they can be combined with proximity sensors, motion sensors, headand eye tracking, a feature which is advantageous for understanding auser's specific field of vision for adjustments, and to measure distancethrough triangulation. For instance, in human eyes there is aconvergence of the image when it comes closer to the face, meaning thatthe image captured by each eye begins to overlap the other eye's image.In 3D camera applications, this convergence is not always taken intoaccount, and the sensors can also be used to automatically change thefield of view presented to the retina, i.e., a virtual zoom to determinefacial features when in proximate distance of another person. When usedin conjunction with a user interface, the zoom, skew or othermanipulation features can be selected in a straightforward method chosenby the user to gain visual acuity in various environments. Adifferential adjustment may also be chosen with regard to each eye.Alternatively, software derived proximity and motion sensing can beemployed by utilizing comparative techniques on sequential cameraimages.

Thus, this invention teaches that one camera can be used for monoscopicimage capture and display. In addition, this invention teaches that youcan use two cameras to simulate on the goggles/glasses display truestereoscopic vision, wherein the IDM (Image Distortion Map) modelincludes factor correction for epipolar curves, guided by the epipolargeometry so that stereo vision, generated by two or more cameras, can beemployed and be displayed, and seen.

The invention uses computer aided video images which are skewed andstretched in a matrix distortion or other similar fashion to put themost or the entirety of the image onto the peripheral vision of thepatient by opening up the center of the image and manipulating it to theperipheral cones of the eyes, as seen by the patient in the projectedimage, in order to project the video captured images on the peripheriesof the cones in the eyes where vision is still active. The benefits ofthis invention are that no invasive procedures are necessary and as theMD changes, the software can be adjusted so that the image is nowcorrectly skewed. It is an additional advantage of this invention thatlive feedback can be provided.

In the fashion taught by this invention, the viewed experience makes itnearly impossible for the user to distinguish between what is actuallyseen and the image that is created by the distortion map.

Thus, the spreading and/or multi-lateral skewing of the image whichreflects the corrected image onto 3D or High-Definition goggles and/orglasses worn by the patient. The image is skewed via the IDM (ImageDistortion Map) module to avoid projection to the area of the eye whichinvolves the macula, but still has all the image information. To imaginethis process, think of a picture which is printed onto a stretchable andcompactable substance. A hole is cut into the middle of the image andstretched open. This makes the image compress into the sides of thepicture. Thus, all of the information of the picture is still there, itis just rearranged where a hole is in the middle and the image is movedeach way to the side, top and bottom. This “hole-cutting” is done viaalgorithms and computer software/firmware technology, for instance,using a technology like Image Distortion Mapping as above mentioned.

Matrix Distortion of a camera and Matrix Calibration, are the correctionof the distortion and are commonly known areas of camera calibration.Oftentimes, cameras display a significant distortion. However, thedistortion is constant, like on a matrix, and with a calibration andsome remapping, the distortion can be corrected. Typical distortioncorrection takes into account the radial and tangential factors. For theradial factor, one uses the following formulas:

x _(corrected) =x(1+k ₁ r ² +k ₂ r ⁴ +k ₂ r ⁶

y _(corrected) =y(1+k ₁ r ² +k ₂ r ⁴ +k ₂ r ⁶,

where r is defined by r=x2 and y2 and k₁ and k₂ are defined by thecoefficients in the retinal map. The corrected x and y values aredesigned to create a corrected position for the pixels in an image,where x and y defined the original position of the uncorrected imagepixel and x_(corrected) and y_(corrected) are the corrected position ofthe pixel. The purpose of the mapping is to take a three-dimensionalmodel of active vision, defined by one of the mapping processesdescribed above, and applying the model to a two-dimensional image, suchthat a pixel on the two-dimensional image is mapped to the correctedlocation of the pixel after applying the function containing thespecific three-dimensional mapping.

In one embodiment, the process maps each pixel in the two-dimensionalimage (or video) from the camera(s) and maps the pixel to a new pixellocation on the display. In another embodiment, only the data points areremapped. The other image data is transformed using a predefinedfunction that interpolates the data between the data points.

So, for an old pixel point at (x,y) coordinates in the input image, itsposition on the corrected output image will be (x_{corrected}y_{corrected}). This corrects for the presence of the radial distortionwhich manifests in the form of the “barrel” or “fish-eye” effect.Tangential distortion occurs because the image taking lenses are notperfectly parallel to the imaging plane. It can be corrected via theformulas:

x _(corrected) =x+[2p ₁ xy+p ₂(r ²+2x ²⁾], and

y _(corrected) =y+[p ₂ xy+p ₁(r ²+2y ²⁾].

However, for this invention a type of reverse methodology is employedthat would not normally be thought of Thus, once typical distortions inthe camera have been fixed, then it is the teaching of this inventionthat an intentional distortion is introduced. In one embodiment, the IDM(Image Distortion Map) model stretches a center pixel to the points atwhich an individual cannot see and compresses everything else to fit inthe remaining peripheral portion of the goggles. In this fashion, a“hole” is artificially cut into the image by computer andsoftware/firmware aided manipulation such that a pixel, which wasformerly in the center of an image, is squeezed to the outside so thatthe entire image is projected around the “hole” in the center which isartificially created. Only the matrix distortion portion of the model isshown here, as the other pieces are not directly related to the IDMmodel, but are other substantive parts of this program for projectingthe image once the IDM model is applied. As shown, the IDM distortionmodel is shown as a value to the “webGL”1, a program which can be usedwith “renderingContext”2. These are only some of the protocols whichcould be used, thus the actual IDM model will change with whateverdevice is used to do the actual processing.

“WebGL” is a JavaScript API for rendering interactive 3D computergraphics and 2D graphics within any compatible web browser without theuse of plug-ins. WebGL is based on OpenGL ES 2.0 and provides an API for3D graphics. “RenderingContext” is a helper type representing any of thefollowing rendering contexts: CanvasRenderingContext2D,WebGLRenderingContext or WebGL2RenderingContext (which inherits fromWebGLRenderingContext).

Samples of the IDM model distortion in webGL can be created as follows:

-   -   vec2 hWa(vec2 in01){vec2 tHt=(in01−1Cr)*sin;        -   float rSq=(tHt.x*tHt.x)+(tHt.y*tHt.y);            -   vec2 pRi=tHt*(hWp.x+                -   hWp.y*rSq+            -   hWp.z*rSq*rSq+            -   hWp.w*rSq*rSq*rSq);            -   return 1Cr+sLe*pRi;}

The hWa method as listed above will take a few input variablesdescribing the image center as it pertains to the particular displaydevice, and it returns a specific Uniform Location value to enable theIDM device to render the corrected projection to the display device. Itdoes all the math to provide the distortion matrix to, in this case, theopenGL graphics driver. The method takes input values regarding thefield of view of the goggles, which are different in different models,and the pupillary distance, and returns the distortion matrix, as afloating point, back to the image processor. As shown above, thevariables used are specifically to apply to a webGL context, which isonly one of many possible implementations. The hWa method takes an inputvariable that describes the image center as it pertains to theparticular display device (like an Oculus Rift), and it returns aspecific Uniform Location value to enable the IDM device to render thecorrected projection to the display device.

The IDM model takes vector values (numbers) that describe the lenscenter of the goggle device (per eye, on the oculus rift) (called“1Cr”), as well as field of view of the display, and returns the vectorobject that defines how to distort the image to make it more viewable bysomeone with macular degeneration. The key element is to define themapping between image (pixel) coordinates and 3D rays in the camera(s)coordinates as a linear combination of nonlinear functions of the imagecoordinates. This allows a linear algorithm to estimate nonlinearmodels, and creates a method to distort the image such that there istypically a (circular) “hole(s)” or a “cut-out(S)”, or a geometricallydistorted area in the center of the image accomplished by moving thepixel coordinates so that the entire image is distorted and mappedaround the hole which is cut-out or to compensate for the geometricdistortion caused by leaking vessels. How this image is exactly cut-outand the pixels rearranged is accomplished through testing with thesubject so that it is attempted to use as many peripheral retinareceptors as that subject has active. This Image Distortion Map (“IDM”)model thus becomes that person's Prescribed Retinal Interface (“PRI”).

This invention has great benefits in that it is non-invasive, can beworn or not worn, and is easier to adjust and keep fine-tuned because itis external, and image and algorithms which stretch and skew the imageto the PRI can be adjusted in real-time based on MD Patient feedback inadjustments.

In another embodiment of the invention, the active retinal receptors areidentified through evaluation with the system or by known prescriptionwhereby the lowest number of receptors in the retina required to effectthe desired mental and visual impression of the image are used toincrease the apparent refresh rate, by actually increasing the refreshrate by displaying the image on less than all of the receptors.

In another aspect of the present invention, various FOV maps are storedand/or analyzed or tracked in a database. The database could be storedin the cloud. A knowledge base based be used to analyze the FOV maps,and one or more of the FOV maps could be used as a starting point for apatient. The selected FOV map could be fine-tuned using one or more ofthe methods described above. A FOV from the database may be chosen as astarting point based on patient visual models, common trends andoutliers within the data. The FOVs models could be sorted and/or chosenbased on identified common boundaries. The output of the different FOVmaps, i.e., the resultant corrected images could be analyzed, withpatient input, utilizing a process of comparison and elimination whileviewing desired real world images, i.e., a face chart, text chart or thelike.

In another aspect of the present invention, the system may provide forin-home monitoring of the patient's vision. The patient's FOV may bemapped periodically, such as daily or as often as desired. The patient'sFOV may be mapped according to method M20 described above, utilizing thewearable HUD, or otherwise as desired. Test results may be sent to thedatabase, which may be cloud-based, where they may be analyzed andcompared. If certain criteria are met, for example if the volumetricsize of the patient's scotoma per eye increases or there now show areasof no sight in areas where there originally was sight, then a message oralert may be sent to the patient's ophthalmologist or retinal surgeon.For example, the message or alert may be sent to the ophthalmologist orretinal surgeon's patient case software, indicating that the physicianneeds to look at the changes to see if there might be a new bleed. If anew bleed is dealt with immediately, the patient's additional retina maybe saved, whereas on the other hand if the bleed were discovered at thepatient's next appointment in 6 months, the damage may be permanent.

A controller, computing device, server or computer, such as describedherein, includes at least one or more processors or processing units anda system memory, which may be an embodiment in a personal computer,server, or other computing device. The controller typically alsoincludes at least some form of computer-readable media. By way ofexample and not limitation, computer-readable media may include computerstorage media and communication media. Computer storage media mayinclude volatile and nonvolatile, removable and non-removable mediaimplemented in any method or technology that enables storage ofinformation, such as computer readable instructions, data structures,program modules, or other data. Communication media typically embodycomputer-readable instructions, data structures, program modules, orother data in a modulated data signal, such as a carrier wave or othertransport mechanism and include any information delivery media. Thoseskilled in the art should be familiar with the modulated data signal,which has one or more of its characteristics set or changed in such amanner as to encode information in the signal. Combinations of any ofthe above are also included within the scope of computer-readable media.

The order of execution or performance of the operations in theembodiments of the invention illustrated and described herein is notessential, unless otherwise specified. That is, the operations describedherein may be performed in any order, unless otherwise specified, andembodiments of the invention may include additional or fewer operationsthan those disclosed herein. For example, it is contemplated thatexecuting or performing a particular operation before, contemporaneouslywith, or after another operation is within the scope of aspects of theinvention.

In some embodiments, a processor or controller, as described herein,includes any programmable system including systems and microcontrollers,reduced instruction set circuits (RISC), application specific integratedcircuits (ASIC), programmable logic circuits (PLC), and any othercircuit or processor capable of executing the functions describedherein. The above examples are exemplary only, and thus are not intendedto limit in any way the definition and/or meaning of the term“processor.”

The above description of illustrated examples of the present invention,including what is described in the Abstract, are not intended to beexhaustive or to be limited to the precise forms disclosed. Whilespecific embodiments of, and examples for, the invention are describedherein for illustrative purposes, various equivalent modifications arepossible without departing from the broader spirit and scope of thepresent invention.

What is claimed is:
 1. A method of at-home monitoring of eye conditions,the method comprising: providing a system to a patient, the systemcomprising a database and a model controller where the model controlleris configured to establish a visual model associated with the patientand to store the visual model in the database, the visual model includesdata related to a quality of the patient's vision, and the data includesdata acquired using eye tracking; testing the patient's eyes with thesystem to produce the visual model; comparing the visual model withprior visual models to detect changes; and notifying a physician of thechanges.
 2. The method of claim 1 where the visual model is establishedusing a computer-based system contained in a head mounted display. 3.The method of claim 1 where the visual model is established using acomputer-based system contained in an Augmented Reality head mounteddisplay.
 4. The method of claim 1 where the visual model is establishedusing a computer-based system contained in a mobile phone.
 5. The methodof claim 1 where testing the patient's eyes occurs regularly.
 6. Themethod of claim 1 where the database is cloud-based.
 7. The method ofclaim 1 where notifying the physician of the changes occurs when thechanges meet designated criteria.
 8. The method of claim 1 wherenotifying the physician of the changes occurs via radio frequencytransmission.
 9. The method of claim 1 where testing the patient's eyesis performed by the patient.
 10. The method of claim 1 where testing thepatient's eyes is performed at the patient's home.
 11. The method ofclaim 1 where the physician is notified remotely if certain criteriaindicating deterioration in the eye occurs.